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OPERATIONS 

5 This invention relates generally to methods and apparatus for 

antialiasing, and in particular for antialiasing image objects, such as colored 
text and graphical line art objects, so that the border or edge pixels of such 
antiaiiased objects exhibit relatively uniform values. 

The aesthetic quality of certain image objects, such as colored 

10 text, in a printed document is strongly dependent on the sharpness and 
continuity of the edges of the image objects when they are reproduced in the 
document. The desired color or gray level of such image objects is commonly 
achieved by a printing process known as halftoning, wherein gray level 
variation is represented by placing a greater or lesser number of saturated 

15 pixels in a discrete portion of the image. However, when halftoning is applied 
in color document reproduction, problems arise in the reproduction of colored 
text and graphical image structures. Accordingly, halftoning is known to 
necessitate a compromise between spatial resolution and color resolution. In 
order to reproduce a given color accurately, a comparatively large halftone 

20 cell is typically desired, as large halftone cells allow more gray levels of each 
color, and therefore, a greater number of colors in the reproduce image. 
Unfortunately, the use of a large halftone cell causes spatial degradation of 
the edges of the text and graphical features, and as a result these edges 
exhibit an unwanted, jagged appearance. Antialiasing is therefore 

25 implemented when digitizing text and graphical image structures, whereby 
intermediate levels of intensity are used to achieve subpixel positioning of 
edges, in order to reduce or eliminate jagged edges In the reproduction of 
lines, polygons, and text. 
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Antialiasing is implemented in conventional practice by first 
capturing an image at a particular resolution (known as super resolution) 
that is greater than the final, or desired, output resolution. Next, the 
captured image resolution is reduced by performing sub-sampling. Such sub- 
5 sampling is typically effected via an averaging process. The resulting gray 
values, produced by averaging the area coverage of back and white at a 
given pixel location, indicate how much of the pixel should be covered by 
white and how much by black. Averaging can be well-suited to create pixel 
values that represent the edge positions of highly saturated (such as fully 
10 black or fully white) objects. One such rendering method as described in U.S. 
Pat. No. 6,167,166, recreates the desired area coverage at print time and 
repositions the edge by using the gray level created in the averaging 
operation. 

However, we have determined that the conventional use of an 
15 averaging process in sub-sampling creates edge pixels having pixel values 
that vary around the border of certain antialiased image objects. This 
undesirable variation becomes apparent, for example, when attempting to 
create outlines for those image objects that comprise pixels having pixel 
values that lie in a range other than saturated or near-saturated levels, 
20 because the outline width is typically made dependent upon the pixel gray 
level. 

Implementation of a high frequency dot screens to render 
antialiased pixels is problematic. When screens rated approximately equal to 
130-150 CPI dots are employed in a rendering module, antialiased pixels are 

25 halftoned and printed, resulting in objectionable halftone dots that appear 
along character edges. 

Hyperacuity printing techniques, for example those described by 
Curry, et al. in U.S. Pat. No. 5,138,339 and U.S. Pat. No. 5,485,289, are 
known to implement a specialized version of rendering for antialiased line 

30 art. However, these techniques require the use of tags to identify the 
antialiased pixels as antialiased line art. In US 6,243,499 there is mentioned 
that it is generally desirable to render the borders for gray objects with a 
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high frequency screen, while it may be desired to render the interior of the 
gray stroke with a lower frequency screen chosen for attributes other than 
edge rendition. Through an optimized use of thresholds, border pixels are 
tagged, and subsequently optimally rendered, in a similar manner to border 
5 pixels that are gray due to antialiasing. This approach for selective rendering 
will produce a high frequency edge outline at a gray-to-white border or 
between two gray levels. 

Accordingly, there remains a need for a method and apparatus 
for creating antialiased image objects such as text and graphical elements 

10 that have resulting outlines which exhibit a uniform appearance. 

The present invention is directed to improved methods and 
apparatus for antialiasing, and in particular for antialiasing image objects 
such as colored text and graphical line art objects such that the edge pixels 
of such antialiased image objects will exhibit relatively uniform pixel values. 

15 In one embodiment of the present invention, there is provided 

an antialiasing method wherein an improved antialiasing filter is employed to 
detect at least one region within the received image. Upon detecting a region 
containing a background image level that adjoins an image object having 
pixel values in a range other than a predetermined range of limit values, the 

20 antialiasing filter sets the pixel values of the edge or border pixels of the 
image object to substantially the same value. 

In a particular aspect of the present invention, adaptive 
selection among a logical filter operation and an averaging filter operation is 
employed in the operation of the antialiasing filter in order to obtain the 

25 desired uniformity of pixel values. Such uniform pixel values are then 
rendered so that uniform outlines are advantageously provided on the edges 
of certain image objects that would otherwise suffer in appearance, such as 
printed text and graphical elements. 

For a general understanding of the present invention, reference 

30 is made to the drawings. In the drawings, like reference numerals have been 
used throughout to designate identical elements. 
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FIG. 1 is a general representation of a suitable system-level 
embodinnent for one or more aspects of the present invention; 

FIG. 2 is a generalized data flow representation of an 
embodiment of the present invention; 
5 FIG. 3 is a generalized data flow representation of an 

embodiment of the present invention that utilizes super resolution 
antialiasing; 

FIG. 4 illustrates antialiasing of an image object wherein the 
resulting outline width is non-uniform; 
10 FIG. 5 illustrates antialiasing of an image object according to the 

present invention whereby the resulting outline width is uniform; 

FIG. 6 is a generalized data flow representation of another 
embodiment of the present invention; 

FIG. 7 is a data flow representation of the operation of one 
15 embodiment of the antialiasing filter of Fig. 6; 

FIG. 8 is a generalized data flow representation of another 
embodiment of the present invention; 

FIG. 9 is a data flow representation of the operation of the 
antialiasing filter of Fig. 8; and 
20 FIG. 10 illustrates antialiasing of an image object according to 

the process illustrated in Fig. 8. 

The invention is described herein with reference to one or more 
embodiments. However, it will be understood that there is no intent to limit 
the invention to the embodiment(s) described. On the contrary, the intent is 
25 to cover all alternatives, modifications, and equivalents as may be included 
within the spirit and scope of the invention as defined by the appended 
claims. 

The term "data" refers herein to physical signals that indicate or 
include information. An "image", a pattern of physical light, may include 
30 "image objects" in the form of characters, words, and text as well as other 
features such as line art, graphics, or graphical structures. An image may be 
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divided into "segments," each of which is itself an image. A segment of an 
image may be of any size up to and including the whole image. 

The term "antiaiiased" is intended to refer to those segments or 
regions of an image that are modified by an antialiasing operation applied to 

5 the image (e.g. an image processing operation or a physical process resulting 
in gray pixels along the edges of image objects). 

Each location in an image may be called a "pixel." Each pixel 
value is a bit in a "binary form" of an image, or a gray scale value in a "gray- 
scale form" of an image, or a set of color space coordinates in a "color- 

10 coordinate form" of an image. The binary form, gray-scale form, and color- 
coordinate forms are each a two-dimensional array defining an image. 
Although described herein as being particularly applicable to continuous-tone 
processing, the present invention applies equally as well to the processing of 
color images, wherein each separation is treated, effectively, as a gray-scale 

15 or continuous-tone image. Accordingly, references herein to the processing of 
continuous-tone (contone) or gray-scale images is intended to include the 
processing of color image separations as well. An operation typically 
performs "image processing" when it operates on an item of data that relates 
to part of an image. 

20 A "limit" pixel level is described as such in order to indicate one 

or more pixel levels that lie within a range of saturation or near-saturation 
gray levels, or within a range of background or near-background levels. The 
realization of near-saturation and near-background gray levels in such 
ranges may be dependent upon the particular imaging system that is 

25 employed, and accordingly limit pixel levels are within a predetermined range 
of between 1 to 5 percent (and for some applications, between 1 to 20 
percent) of each of the minimum and maximum gray levels of a particular 
imaging system. 

An "image input device" is a device that can receive an image 
30 and provide an item of data defining a version of the image. A "scanner" is 
an image input device that receives an image by a scanning operation, such 
as by scanning a document. 
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An "image output device" is a device that can receive an item of 
data defining an image and provide or render the image as output. A 
"display" is an image output device that provides the output image in human 
viewable form. 

5 "Halftoning" refers to rendering the digital image to a bit map 

form that can be used to drive the imaging device. Early meanings of the 
term "halftone" as an operation tended to connote production of a binary 
image, whereas the evolution of imaging technology has expanded the 
meaning to indicate a process that prepares the pixels for driving the 

10 imaging devices. For printing devices, the halftone image that is created is 
usually in a form such binary pixels, high addressability pixels, pulse width 
modulation codes, or some reduced quantization form that is compatible with 
the imaging device in the printer. Halftoning in the present context includes 
rendering antialiased pixels to high addressable form using specialized 

15 rendering cells, as for example, described in U.S. Patent 6,167,165. The 
halftoning operation may also be directed through the use of tags, as for 
example, described in these U.S. Patents: 6,167,166; 6,243,499; and 
6,144,461. 

"Resolution" in the present context refers to the number of 
20 pixels per inch in a digital image. It is sometimes referred to as dots per inch 
(dpi), or spots per inch (spi). 

"Graphical features," "line art objects," and "text" typically refer 
to computer-generated features in an image as opposed to pictorial or 
natural scene content. The terms may also be used to describe computer- 
25 generated features that have been printed and re-digitized with a device 
such as an input scanner. 

Turning now to FIG. 1, depicted therein is an embodiment of a 
preferred digital imaging system 100 that includes an image source 110 for 
generating image data that is supplied to an image processing system 120, 
30 the latter incorporating what is known in the art as a digital front end (DFE). 
The image processing system 120 produces output image data for rendering 
by print engine 130. Image source 110 may include scanner 112, computer 
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114, network 116, or other similar or equivalent image input components. 
Print engine 130 is preferably a xerographic engine; however, the print 
engine 130 may include alternative printing or reprographic technologies 
such as photographic, ionographic, ink jet, etc. The following description of 
5 the present invention is directed towards operation of the image processor 
120, wherein a novel method for antialiasing includes outlining of selected 
image objects, such as text and graphical elements. Such outlining reduces 
jagged edges and thus improves the appearance of the image object. In 
particular embodiments, the outlines are made uniform in appearance about 

10 the perimeter of the image object. 

Referring now to FIG. 2, shown therein is a general flow chart 
200 of steps operable in an embodiment of the present invention. An input 
image received in step 210 is input to an antialiasing and sampling step 220 
wherein an input image is processed by a novel antialiasing filtering 

15 operation which produces an image having one or more image objects that 
are aesthetically improved by exhibiting uniform border values. The 
contemplated filtering operation is tailored to the various forms of the input 
image, such as a Page Description Language (PDL) form or a digital form. If 
the input image is provided in a PDL form, the uniform boundary values on 

20 image objects are created by the antialiasing filter so as to provide an 
intermediate form of a PDL object that is fitted to establish a border on the 
image object. Alternatively, the uniform boundary values on image objects 
may be provided in the form of digital pixel values that are placed into the 
input image when the image is sampled. A sampling operation is optionally 

25 included in step 220, which could be implemented as a digital sampling of a 
PDL object, sometimes called a Raster Image Processing (RIP) operation, or 
it can be implemented as a subsampling or resampling of a digital image. In 
step 230 there is provided halftone rendering of the digital image in order to 
output, in step 240, a bit map image format that can then be used to drive 

30 an imaging device. 

The operation of the antialiasing filter includes selective 
implementation of a logical filter and/or an averaging filter; selection is made 
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according to criteria associated with the image object to be filtered, as will be 
described in greater detail below. For processing a digital image, the logical 
filter is contemplated as being implemented in one of several classes or 
forms, such as a "max filter/' wherein the maximum pixel value within an 
5 observation window of pixels is used to provide the pixel output value. 
Another embodiment of a logical filter that is particularly useful for achieving 
the desired uniform border is one chosen from the class of order-statistic 
filters, within which the "max filter" is one choice. Order-statistic filters base 
their output on a ranking of pixel values within the window. For instance, the 

10 chosen values could be the value In the range of observed values that is the 
highest value (using a "max filter"), lowest value (using a "min filter"), or an 
intermediate value (using a "median filter") . Yet another filter class that is 
particularly useful for achieving the uniform border is a filter based on counts 
of pixel values. For instance, in a 4x4 pixel observation window, if 8 or more 

15 pixels are determined as possessing the graphical object gray level, then that 
gray level is chosen as the output value, and less than 8 pixels at that level 
will produce the background level as the output value. The input image could 
be one of a plurality of formats, including command-based and pixel-based 
formats. For instance, the input image may include a computer file of Page 

20 Description Language (PDL) commands that describe the image content in a 
computer language functional form. The form of the input image can be that 
of a gray-scale digital image, wherein pixel values represent gray levels or 
color values at the pixel location. 

FIG. 3 illustrates a general flow chart 300 of steps operable in 

25 another embodiment of present invention that utilizes super resolution 
antialiasing. With respect to super resolution input digital images, the 
averaging operation typically averages gray values of pixels within a block of 
super resolution pixels so as to then reduce the block of pixels to a single 
pixel, but note that a larger window of pixels can be used in the averaging 

30 operation. For digital images at the same input and output resolution, 
averaging is performed using a window of pixels about a target pixel. 
Averaging within a PDL (mage representation will average gray values of 
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underlying objects, wherein the local area coverage of an object affects the 
weighting in the average. In step 310 an input image nnay be provided in PDL 
fornri, that is rasterized in step 315 to a resolution higher than the resolution 
that will be used in the halftoning step 330. For example, a rasterizer may be 
5 employed to digitize the image to 1200 pixels/inch and the pixel resolution 
before halftoning may be 600 pixels/inch. A logical filtering and optional 
sampling operation is performed in antialiasing step 320 to reduce groups of 
high resolution pixels to reduced resolution pixels having a comparably lower 
resolution. For example, if the super resolution is 1200 spi and the resolution 

10 to the halftoner is 600 spi, then counts of pixels values can be performed on 
2x2 blocks. When suitable tags are not present, a counting algorithm may be 
employed to set the output value to an observed gray level, if that observed 
gray level occurs in half or more of the pixels in the block, and outputs the 
background value otherwise. In step 330 there is provided halftone rendering 

15 of the digital image in order to output, in step 340, a bit map image format 
that can then be used to drive an imaging device. 

FIG. 4 represents the transformation of an input image object 
according to operation of an embodiment of the present invention. A 
graphical object 410 possessing a gray level that is a middle tone in the gray 

20 range is first rasterized in step 420 to super resolution information. For 
example, in an eight bit per pixel system, the gray range is 0 to 255, and the 
midtone is rasterized to pixels having values of 128. A rasterized graphical 
object at 1200 spi is then filtered in step 430 by averaging 2x2 blocks of 
pixels and sampling the value of the average to produce an antialiased 

25 graphical object at 600 spi. The antialiased graphical object is rendered in 
step 440 with a halftone process to produce a rendered graphical object 441 
having border pixels 442 and 444. The halftone process employs a 600 
cell/inch vertical line screen. In the illustrated transformation, the interior of 
the antialiased graphical object is halftoned with a halftone method that is 

30 optimized for optimum gray level representation. In the illustrated instance, 
a 212 cell/inch dot screen at 45 degree halftone is used for the pixels in the 
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interior of the stroke, and tlie outermost pixels are halftoned with a halftone 
method that produces an outline formed of border pixels 442, 444. 

Accordingly, one may discern in Fig. 4 that the thickness of the 
outline differs on at least two sides of the rendered graphical object 441. 
5 Such non-uniformity is a result of the averaging processing, which produces 
border pixels 442 having values on one side that differs from the border 
pixels 444 on another side of the graphical object. One side has border pixels 
442 with value 128, while the other side has border pixels 444 having value 
64. 

10 FIG. 5 represents the transformation of a PDL object 510 

according to operation of another embodiment of the present invention. The 
PDL object 410 is rasterized in step 520 to the resolution that is input to the 
halftoning process, and antialiasing is not performed. The rasterized 
graphical object 520 has pixels at 600 spi and all pixel values are 128. In the 

15 halftoning step 540, the interior of the object is halftoned with a halftone 
method that is optimized for optimum gray level representation and the 
boundary pixels are halftoned with a halftone method that produces an 
outline of the graphical object formed of the desired border pixels. The 
halftoning process yields a halftoned image object 551. Note that the outline 

20 is uniform on the two sides of the object. This uniformity is a result of the 
edge pixels 552, 554 that exhibit uniform pixel values. 

FIG. 6 illustrates a general flow chart 600 of steps operable in 
an embodiment of present invention that utilizes an antialiasing filter. An 
input image is received in step 610 and is processed by the antialiasing filter 

25 in step 620. In the contemplated antialiasing filter, the application of filtering 
and resampling is selectively applied according to the local image structure of 
the input image to be processed. The processing of pixels in an image object 
having limit pixel values is performed using an antialiasing filter of the 
averaging type. For image objects having pixel values outside of a 

30 predetermined range of limit pixel values, such as pixel values having an 
intermediate gray level and which are present on a white or gray 
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background, the processing of pixels is perfornned using an antialiasing filter 
that creates a uniform gray level at the border of the object. 

For exannple, in the adaptive processing of an unsaturated line 
art object, the antialiasing filter is operable on a received image to create an 
5 improved antialiased image, whereby the antialiasing filter detects at least 
one region within the received image, and upon observing a region 
containing a background image level that adjoins an unsaturated line art 
object, the antialiasing filter sets the gray values of the edges of the 
unsaturated line art object to be substantially the same value. 

10 In step 630, the antialiased image is halftoned and rendered to 

a bit map form that can be used to drive an imaging device. The rendered 
image is output in step 640. The appearance of the rendered image therefore 
benefits from image objects that are uniformly outlined. 

FIG. 7 is a data flow representation of the operation of one 

15 embodiment of the antialiasing filter of Fig. 6. An input image, possibly 
including tags, is received in step 710 by the antialiasing filter 700. If 
present, the tags may represent various states that describe an image 
feature or pixel, such as antialiased pixel, colored text object, fine line, 
pictorial, etc. The antialiasing filter first examines, in step 720, a region of 

20 interest about a target location to determine if the region contains a gray 
(unsaturated) graphical feature adjacent to a white or gray background. The 
examination operation can be performed by various methods, such as by 
examining pixel values and tag states in an observation window of pixels and 
tags in digital image, or by examining objects presented in a Page 

25 Description Language format. If, for example, an image object having gray 
graphical feature is determined to be adjacent to a white or gray background 
at the target location, a logical filter in step 730 is selectively operated to 
produce edge values that are uniform around the image object. 

In contrast, if the region of interest does not possess a gray 

30 graphical feature adjacent to a white or gray background, then the 
antialiasing filter employs, in step 740, an averaging filter to produce edge 
values that represent edge position from acquired samples from the input 
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image. The results of the logical and averaging filtering operations are 
combined in step 750 to form an output image. Note that for either of the 
averaging or logical filter operations, the final output value may be further 
modified from the value determined by the specified filter operation to enable 
5 better representation in the final image. For example, the output value of a 
count filter may be increased by 25% to yield slightly darker outlines, or the 
output of a count filter may receive an added or subtracted value to lighten 
or darken an outline. 

FIG. 8 is a generalized data flow representation of another 

10 embodiment of the present invention that employs super resolution 
antialiasing. A PDL input image containing graphical objects is received in 
step 810 and in step 820 is rasterized to a super resolution. For example, for 
an expected resolution at the halftoner of 600 spi, a super resolution of 1200 
spi, 1800 spi, or 2400 spi may be effected by a rasterizing image processor 

15 (RIP). In super resolution antialiasing, the high resolution is typically an 
integer multiple of the resolution that will be input to the halftoner. For that 
resolution condition, an NxM rectangle block of super resolution pixels may 
be converted to a single pixel for the halftoner. For example, a super 
resolution of 1200 spi for a halftoner resolution of 600 spi can be thought of 

20 as 2x2 pixel blocks, wherein each 2x2 pixel block will be used to fprm a 
single pixel to the halftoner. The antialiasing filter is employed in step 830 to 
process the super resolution image to provide an antialiased image at a 
resolution that is suitable for input to a halftoner. The halftoning in step 840 
produces an output image that benefits from graphical features that are 

25 uniformly outlined, and can possess graphical features with edge positions 
that are optimally represented due to averaging operations selected by the 
antialiasing filter for antialiasing object possessing limit pixel values. The 
antialiased image is output in step 850. 

FIG. 9 is a data flow representation of the operation of the 

30 antialiasing filter of Fig. 8. A high resolution digital image, possibly 
incorporating tags, is input in step 910 to the antialiasing filter 900. The 
digital image in a region of interest at a target location is examined in step 
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920 to determine whether the region contains pixel having values other than 
those within a predetermined range of limit pixel values. One method that is 
well-suited for the super resolution antialiasing is a decision-based algorithm 
that counts pixel values. If no fully-saturated (i.e., 255) pixel values are 
5 detected, then the pixel block is processed in step 930 with a logical filter. 
The logical filtering can proceed as described above. The determination may 
also be based upon a tag value that indicates that the pixel block contains 
unsaturated graphical features, or may be based upon a tag that explicitly 
indicates that a logical filter should be employed. Alternatively, in step 940, 

10 an averaging filter is employed to average pixel values over qualifying pixel 
blocks and to output an average value. The results of the logical and 
averaging filtering operations are combined in step 950 to output an 
antialiased image. 

FIG. 10 illustrates transformation of an image object according 

15 to the antialiasing process illustrated in Fig. 8. An image object 1010 that 
possesses a gray level that is a middle tone of the gray range is received and 
is rasterized to 1200 spi in step 1020. For example, in an 8 bit/pixel system, 
the gray range is 0 to 255, and the midtone rasterizes to pixels having 
values of 128. The image is filtered by the contemplated antialiasing filter 

20 and is sampled to produce a 600 spi antialiased image in step 1030. As 
shown in FIG. 10, the selective filtering operation produces uniform border 
values on the two sides of the image object. The image is halftoned in step 
1040 to produce an antialiased graphical object 1051 that exhibits that 
desired uniformity of border pixels 1052, 1054. The interior of the graphical 

25 object is halftoned with a halftone method that is optimized for optimum gray 
level representation. In the illustrated process, a 212 cell/inch dot screen at 
45 degrees halftone is used for the interior of the image object. The 
boundary pixels are halftoned with a halftone method that produces an 
outline of the graphical object formed of the border pixels. In the illustrated 

30 process, the chosen halftone method is a 600 cell/inch vertical line screen. 

Additional image processing techniques are contemplated as 
being included within the scope of the present invention. For example, it 
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may be desirable to strengthen or weaken the pixel value present at an 
inside or outside corner of an image object Strengthening the value of an 
outside corner is sometimes referred to as "corner sharpening" and a 
weakened inside corner is often referred to as an "ink trap." For corner 

5 regions, the operation of the contemplated antialiasing filter can be 
modified to provide image values that are stronger or weaker than the 
values provided for the remainder of the border. Identification of pixel 
values present at an inside or outside corner of an image object is taught in 
Loce et al., U.S. Patent Application SN 09/579,089, entitled: "IMAGE 

10 PROCESSING METHOD FOR SHARPENING CORNERS OF TEXT AND LINE 
ART", the content of which is incorporated herein by reference. 

Some marking engines will exhibit certain directionally- 
dependent marking characteristics for one or more of vertical, horizontal, 
leading edge, or trailing edge image structures. If such a marking engine is 

15 employed, the antialiasing filter can also be modified to provide higher or 
lower image values for a particular edge orientation in order to pre- 
compensate for the directionally-dependant response of the particular 
marking process. 

Also, the examples of super resolution processing illustrated 

20 herein employ averaging and logical filters that can operate to reduce a pixel 
block to a single value. Alternatively, the filters may use pixel values outside 
of a pixel reduction block to identify with greater certainty that a target 
region is associated with a particular type of graphical feature. In still 
another alternative, a larger window of pixels may be used to generate a 

25 more accurate output value. 

The content of the following patents are hereby incorporated by 
reference for their teachings: U.S. Pat. Nos. 6,144,461; 6,020,979; 
6,243,499; 6,137,918; and 6,167,166. 

While this invention has been described in conjunction with 

30 preferred embodiments thereof, it is evident that many alternatives, 
modifications, and variations will be apparent to those skilled in the art. 



14 



Accordingly, it is intended to embrace all such alternatives, modifications and 
variations that fall within the spirit and broad scope of the appended claims. 
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